The Reliability of Visual Ratings of Velopharyngeal Physiology for Speech.

BACKGROUND: Analyze intrarater and interrater reliability for evaluating endoscopic images of velopharyngeal (VP) physiology. METHOD: Speakers produced 9 speech stimuli representing 4 stimulus types: sustained phonemes, repetitions of "puh," single words, and short phrases. The 37-speaker participants included 16 patients with VP dysfunction and 21 control participants. Five raters independently rated the video images for degree of VP opening, location of opening, and pattern of closure. Outcome measures included intrarater and interrater measures of reliability and the effects of raters and stimulus type on ratings. RESULTS: Intrarater reliability was acceptable, and ratings were logically consistent. Fixed effects regression coefficients for the patient and the control groups showed that raters were a significant source of variability for degree of opening and pattern of closing. Stimulus type was not a significant source of variation for any metric for the controls, but stimulus type was a significant determinant for degree of opening for patients. The degree of opening was larger for sustained phonemes than for the other speech stimuli. Ratings for degree of opening were most similar for repeated "puh." CONCLUSIONS: Interrater reliability needs to be improved so that the assessment procedure produces more consistent findings among clinicians, thus strengthening our evidence base for this procedure. Interrater additional research is needed to understand how the stimulus affects ratings of VP physiology, to identify stimuli that yield the most useful clinical information, and to understand how training affects the ratings of VP physiology.

Impacts of shifting responsibility for high-cost individuals on Health Insurance Exchange plan premiums and cost-sharing provisions.

Insurance companies can respond to increases in expected per-capita healthcare expenditures by adjusting premiums, cost-sharing requirements, and/or plan generosity. We use a Difference-in-Difference model with Plan-level Fixed Effects to estimate the impacts of increases in expected expenditures generated by closure of state-operated High Risk Pools (HRPs). For Silver plans, we find that issuers responded to HRP closures by increasing both premiums and deductibles, and by increasing the ratios of premiums to deductibles. This adjustment to the structure of plan prices is consistent with the hypothesis that issuers will be reluctant to adjust deductibles, because consumers tend to overweight changes in deductibles over changes in premiums. The increase in the ratio of premiums to deductibles indicates that the increase in expected expenditures triggered an increase in the share of total risk-pool healthcare expenditures paid by low healthcare utilizers, and a decrease in the share paid by high utilizers.

Incentive design to boost health for juveniles with Medicaid coverage: Evidence from a field experiment.

Augmenting incentives for juveniles with separate incentives for parents could boost juvenile efforts to reduce BMI. However, financing a parent incentive by reducing the incentives offered to adolescents could attenuate the juvenile response. In a field experiment, Medicaid-covered juveniles enrolled in a cardiac wellness program were randomly assigned to two groups: juveniles in the focused-incentive group received all earned points; juveniles in the split-incentive group split earned points with a parent. The focused-incentive group was 12.8 percentage points more likely to achieve their stipulated goals compared to the split-incentive group at the end of the 3-month active phase of the program. In contrast, members of the split-incentive group outperformed their peers in the focused-incentive group during the second quarter, and the two incentives structures were equally effective at the year-end session. Additional quasi-experimental data indicates that members of both incentivized groups significantly outperformed (focused-incentive group by 8.48 percentage points and split-incentive group by 11.0 percentage points) a pre-experiment (non-incentivized) set of juveniles enrolled in the same program at year-end.

Evaluating an employee wellness program.

What criteria should be used to evaluate the impact of a new employee wellness program when the initial vendor contract expires? Published academic literature focuses on return-on-investment as the gold standard for wellness program evaluation, and a recent meta-analysis concludes that wellness programs can generate net savings after one or two years. In contrast, surveys indicate that fewer than half of these programs report net savings, and actuarial analysts argue that return-on-investment is an unrealistic metric for evaluating new programs. These analysts argue that evaluation of new programs should focus on contract management issues, such as the vendor's ability to: (i) recruit employees to participate and (ii) induce behavior change. We compute difference-in-difference propensity score matching estimates of the impact of a wellness program implemented by a mid-sized employer. The analysis includes one year of pre-implementation data and three years of post-implementation data. We find that the program successfully recruited a broad spectrum of employees to participate, and it successfully induced short-term behavior change, as manifested by increased preventive screening. However, the effects on health care expenditures are positive (but insignificant). If it is unrealistic to expect new programs to significantly reduce healthcare costs in a few years, then focusing on return-on-investment as the gold standard metric may lead to early termination of potentially useful wellness programs. Focusing short-term analysis of new programs on short-term measures may provide a more realistic evaluation strategy.

Are prenatal care resources distributed efficiently across high-risk and low-risk mothers?

The Institute for Clinical Systems Improvement recommends reducing the number of prenatal care visits recommended for low-risk women, citing evidence from a randomized clinical trial indicating that the reduction would not adversely impact infant health. We investigate the implicit hypothesis that prenatal care resources are not distributed efficiently across high-risk and low-risk women. Using clinic-reported prenatal care and an inclusive measure of infant health, we report evidence indicating inefficient resource utilization: prenatal care only boosts infant health when mothers have specific pre-existing diagnoses, but women with high potential to benefit from care do not obtain more care than other women.

Treatment effects model for assessing disease management: measuring outcomes and strengthening program management.

This paper describes an analytical methodology for obtaining statistically unbiased outcomes estimates for programs in which participation decisions may be correlated with variables that impact outcomes. This methodology is particularly useful for intraorganizational program evaluations conducted for business purposes. In this situation, data is likely to be available for a population of managed care members who are eligible to participate in a disease management (DM) program, with some electing to participate while others eschew the opportunity. The most pragmatic analytical strategy for in-house evaluation of such programs is likely to be the pre-intervention/post-intervention design in which the control group consists of people who were invited to participate in the DM program, but declined the invitation. Regression estimates of program impacts may be statistically biased if factors that impact participation decisions are correlated with outcomes measures. This paper describes an econometric procedure, the Treatment Effects model, developed to produce statistically unbiased estimates of program impacts in this type of situation. Two equations are estimated to (a) estimate the impacts of patient characteristics on decisions to participate in the program, and then (b) use this information to produce a statistically unbiased estimate of the impact of program participation on outcomes. This methodology is well-established in economics and econometrics, but has not been widely applied in the DM outcomes measurement literature; hence, this paper focuses on one illustrative application.